Backstepping Controller Design for Nonlinear Stochastic Systems under a Risk-sensitive Cost Criterion

This paper develops a methodology for recursive construction of optimal and nearoptimal controllers for strict-feedback stochastic nonlinear systems under a risk-sensitive cost function criterion. The design procedure follows the integrator backstepping methodology, and the controllers obtained guarantee any desired achievable level of long-term average cost for a given risk-sensitivity parameter θ. Furthermore, they lead to closed-loop system trajectories that are bounded in probability, and in some cases asymptotically stable in the large. These results also generalize to nonlinear systems with strongly stabilizable zero dynamics. A numerical example included in the paper illustrates the analytical results.